Locally Weighted Full Covariance Gaussian Density Estimation
نویسندگان
چکیده
We describe an interesting application of the principle of local learning to density estimation. Locally weighted fitting of a Gaussian with a regularized full covariance matrix yields a density estimator which displays improved behavior in the case where much of the probability mass is concentrated along a low dimensional manifold. While the proposed estimator is not guaranteed to integrate to 1 with a finite sample size, we prove asymptotic convergence to the true density. Experimental results illustrating the advantages of this estimator over classic non-parametric estimators are presented.
منابع مشابه
MAGIC: Exact Bayesian Covariance Estimation and Signal Reconstruction for Gaussian Random Fields
In this talk I describe MAGIC [1], an efficient approach to covariance estimation and signal reconstruction for Gaussian random fields (MAGIC Allows Global Inference of Covariance). It solves a long-standing problem in the field of cosmic microwave background (CMB) data analysis but is in fact a general technique that can be applied to noisy, contaminated and incomplete or censored measurements...
متن کاملAdaptive Bayesian multivariate density estimation with Dirichlet mixtures
We show that rate-adaptive multivariate density estimation can be performed using Bayesian methods based on Dirichlet mixtures of normal kernels with a prior distribution on the kernel’s covariance matrix parameter. We derive sufficient conditions on the prior specification that guarantee convergence to a true density at a rate that is minimax optimal for the smoothness class to which the true ...
متن کاملMultiple-snapshots BSS with general covariance structures: A partial maximum likelihood approach involving weighted joint diagonalization
Maximum Likelihood (ML) blind separation of Gaussian sources with different temporal covariance structures generally requires the estimation of the underlying temporal covariance matrices. The possible availability of multiple realizations (“snapshots”) of the mixtures (all synchronized to some external stimulus) may enable such estimation. In general, however, since these temporal covariance m...
متن کاملmclust 5: Clustering, Classification and Density Estimation Using Gaussian Finite Mixture Models.
Finite mixture models are being used increasingly to model a wide variety of random phenomena for clustering, classification and density estimation. mclust is a powerful and popular package which allows modelling of data as a Gaussian finite mixture with different covariance structures and different numbers of mixture components, for a variety of purposes of analysis. Recently, version 5 of the...
متن کاملImproved Single Frequency Estimation with Wide Acquisition Range
An improved method for estimating the frequency of a single complex sinusoid in complex additive white Gaussian noise is proposed. The method uses a modified version of the weighted linear predictor to achieve optimal accuracy at low/moderate SNR while retaining its speed and wide acquisition range. Consequently, it has an advantage over known methods that use the weighted phase averager since ...
متن کامل